What Happens to the Scores? The Effects of Learning Management Systems Use on Students' Course Evaluations

Learning Management Systems (LMS) are web-based systems that allow instructors and/or students to share materials, submit and return assignments, and communicate online. In this study, we explored the possible effects of LMS use on students' assessments of courses, instructor effectiveness, and their own learning. We examined the relationship between instructors' LMS use over two academic terms and three items from students’ course evaluations, and used the results from a user survey to inform our understanding of the relationship between course ratings and LMS use. Findings suggest that students do not rate courses more highly when instructors use LMSs. However, survey data shows that students value LMSs but perhaps for reasons different from instructors’. As instructors gain experience with tools within LMSs that foster interaction outside the classroom, their use of these systems may lead to improvements in course evaluation scores. Technology-enabled learning is increasingly important and pervasive in higher education. Course Management Systems (CMS) or Learning Management Systems (LMS) are web-based systems that allow instructors and/or students to share instructional materials, make class announcements, submit and return course assignments, and communicate with each other online. A recent report showed that over 90% of all universities and colleges have established one or more LMS-type products for student and faculty use (Hawkins, Rudy, & Nicolich, 2005). While the adoption rate for these systems has been very rapid, little is known about when and how these systems benefit learning (Koszalka & Ganesan, 2004). The goal of this study was to explore the effects of using a LMS on students' ratings of courses, instructors, and their own learning. Specifically, we examined instructors' use of the LMS over two academic terms and analyzed three standard items from students’ course evaluations submitted at the end of each term. Results from a user survey administered to instructors and students were used to inform our understanding of the relationship between course ratings and LMS use. Theoretical Framework New technologies, such as LMS, provide opportunities to change existing teaching practices and have the potential to make teaching more efficient. However, a LMS can also provide functionality beyond making standard course content easily available online. Specifically, new technologies can facilitate a shift from "the transmission of information towards the management and facilitation of student learning," adhering to constructivist tenants of instruction (Coaldrake & Stedman, 1999, p. 7). Whether instructors use new technologies and 1 The survey instrument is available upon request.